esp@cenet document view 



DECISION TREE LEARNING AND GENERATING DEVICE 



Patent number: JP70931 58 

Publication date: 1 995-04-07 

Inventor: ORIHARA RYOHEI 

Applicant: TOSHIBA CORP 
Classification: 

- international: G06F9/44; G06F1 5/1 8 

- european: 

Application number: JP1 99302381 50 19930924 
Priority number(s): 



Abstract of JP7093158 
PURPOSEiTo automatically generate a 
decision tree for feature amount classification 
to take continuous values. 
CONSTITUTION: As the device to obtain rules 
for classifying a case data (DT) set into 
correspondent classification classes (CL) 
among previously decided CL corresponding 
to the plural kinds of feature amounts 
concerning the set of plural DT provided with 
the two kinds of feature amounts of a first 
feature amount (D1 ) expressing the feature of 
a case and a second feature amount (D2) 
expressing an attribute for classification at 
least, this device is constituted by providing a 
means to successively fetch the plural applied 
DT, to calculate difference (df) between the 
maximum value and minimum value of D1 by 
attributes, to divide it into a certain number of 
calculate decided by the df and relevant 
grading until the value of this df after division 
gets less than the value of grading of 
classification decided for classifying D1, to 
define the result as CL and to generate the 
decision tree by deciding the critical value 
range of the feature values of respective 
adjacent CL with the intermediate value of the 
closest value among the feature values of 
respective CL in the case of division, and a 
means to finish the generation of the decision 
tree when the class division error rate of 
respective CL reaches a previously decided 
set value. 
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[«fflF»*©<EH] 

[it mm i ] i <ow&& t . #s 

£ LT, 

fe^coffii: \z. 4 t) 5££ 5 9 7 * *Wft\z.ftm vx#m* 

[000 1] 
[0 0 0 2] 

■OlBO-«feIUSrji.#ltUJb, «ffc**«as#*.6»Jxfc 

-r s t s o fetes &-r 5 ^s^b*5 nis $ n-c v % s 0 
[ooo3] mwtwm&tiz^znft? 1 ?* 

^Jt"— ^li, 2o(OtfiNi (=604 ~ 695) *J4tF « 
Nz ( = A, B) ir. #^7* (CI ~C5 ) 

[0 0 0 4] -t LT> *#J^-^©^o#$c:i:£fHffiL 

x^KD^m^-^n^mm^m^ t^otzx? Kim 
m.m*m<3>m<r>K&mb\.x^ w*M.*fmm&.b 

"IT i-fS* (yy-) tftfet©) 
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[0 0 0 5] El 8 14, ±i£LfcE7 0*flS|{C*fLT, 

2 cDfit^ "A" -efcot, #»tNi ©fi£25 "6 14. 
5" »T46tf. ^^v^.liC4 , ^^t?^<> 
ftNi ©fita* "614. 5" 4 9 At < "649. 5" 
ETFfcfetf-, #S^7*I4C5 , -J £e5 

[0 0 0 6] 0 914. ^feKDSt^^S^groei^Sr^ 

Uctrot-feo, in i o tt^*p<Dgt^^W3£«wiaa 

(Dffitl&mLtz.i>CDX'ibZ>o H9IC*3V^, 9 114*^ 

^^IftTWieWCfcor, #®*51^SB9 4tcj;o-C 

fcx— * S U *ti?tiff>tl&izi 

V^-CEI 10OSt81 ©^.-t 1 •y'T'WI^coteatrS^Wl- 

t>©T-*>*K c©u#, ^^ro^*9 9ic. siR^ix 

5£*£/SS|S9 3 -C*>5. 9 4 l4*Br«fiiSiRS&-r?*>o-C\ 

»«**SifOffl[-C*>a*»S:a*t*-5<»<0-C*>5 0 

9 5l4»j^flSSrEraiC^J-t-5ri:l-J:o-Cie-B-6<3^ta 

(s) t^tro»tAi K:ov>-c, ^©^HSftri 5 
if©fi£-?fc 5 jWh 4 o X =f— 9 £##1 L/c|&©#gl5#© 
tffgaofpE (Ai , S) , $ Ibl^CDMgain (Ai , 
S) =1 (S) — E (Ai , S) £H-g-r-5t><D-C$> 
9, iOMgain (Ai , S) *S*t*#V^«ft«r»* 
O^±igC0#m*51^a5 9 4 T'*>5) 0 

[0 0 0 7] 9 7l4gfc)fe*ffl;*jgB-efco-t\ 

[0 0 0 8] CO 4 5 &t»/&<£>S£*3£Bl4, o#*C0 4 5 
TKfffflf-^i'A^JIlSt (ilO<OSt80) , 

9*T?*>5»3H»9i|lM3ttt (prune rate) W_h^^fc 
SS^i^WWfSixS (01OOSt81) o 
[0 0 0 9] tW?ffcot, -r-<rwS!)#^il(3iS 
LtcoVNT, -^l4"9l^Cr ^:>iSBX.-CV^S^e>l4 (01 
0CS182) , gt^W^jffl$9 T^^fiic^O^T^g 
9Sr^7tc9 8 £ LTttWL (Ell OOS t 8 3) . 

[0 0 10] t5t?4v^btf, ^*^gC9 3(4, 
Wft«M4»9 4 (^4oTjl^^tifc#m*^t*OfiSr- 
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fJU -tit-ehoSB^-lcoi^T (§lO©St8 1) W 
*o&;£* (9 9) \zm9L£i%1t&Wl&ZtfVto*.ZZ 
[0 0 1 l] «±o&g|;::fclt51$®;I:Ojl$RI4, o#* 

xv. $-x.btitcy'—?s<D&omn&i (s) t. -r [0012] 

-<-CW#®S:Ai Idol^T, if OfilL-e*> 5* [&l] 

n 

I (S) - - ^ P)i CS) I o gj Pk (S) 
k = l 

E (A i , S) = Y> 

S j <= A i <c<fc * 

[ 0 0 1 3 ] mi-ov>xii, r##s:Sfc2j 

(Quinlan, J. R. , "Induction of Decision Trees " , 
Machine Learning Vol. 1, 1986. ) |CPLV\ -OBf, <b 

\^<&m^\z. : mmm.*bz>h<nfrh<>tzt£bt5. m 1 o 20 

OS t 8 4) , ifiK«[W«*e*fl:36«9 5K±oT, 
aBtttt* KIBOSH" 3 r i: ±ore#WW«*l-*ft 

l (01 oos t 8 6) , tmmz&.*> 0 
[0014] wT-eti, mmmmm&ti^tmm.9 51c 

v^T^-rs, Ell 1(4, j!J&fe*HS£ie-9-'ffc!£tt9 5 
lc*3 v ffl v n h tiZ <o e W#$J r /u =r y x a otfijo 
«fi8«r*bfct©-C*>9, Hi 214, %Btffi<BEIfl]Sr£» 
#Ji-5*Q;S (E110OS8 6) lc:joV^TJflv^<bix5^&] 
coEP^fJT/i'^y X^ro^JtcJoits^Scosfttt^^L 30 

[0015] ^T-*%&/m$imf&§txj]n7 1 

#«fit*SA*$tt5 (El 1 2 cos t 3 0) „ Xtl&fr 

[0016] %m7 ! -*fmm zhk a*>£h 

ftm-fZ (012COS131) . ^SMSftffWb 

(Ell 2©S t 3 2) . ffWbSttfciWSaF^Sfflf* 
-*8 1K*fU t£#ttft5£S(5 7 4 14, P^ofc^S^ 
fw, , w 2 ICftLT, &LT<D#:X-8l:ibbixZ>mftm.B 

zmm-FZo mi- ttL&m&!kvr 1 nmmmAo 
■f. 

[0 0 17] 

B= (ma di +mi d2 ) / (di +d2 ) 



(Ai . S) . $<blC^:Oggain (Ai , S) = I 
(S) -E (Ai , S) SrlrffL (S t 8 5) . Mgain 
(Ai , S) i>mt>*Z\<^¥T®.mZMX (S t 8 7) - 

tizx^xrtjo wr-c, ftmr^xZCo , ci . 
i rotam^s^Pi (s) atit. 



i 



I (S|) 



I s 

S©#!« 

lc*fU wi tpo^-*-?, wi IclPJ 9 It t> Jxfc-SII?- 
ttrt K#«fi A OteasjH $ * v * {> OOfi l&i>K f-ibiktb 
ibftfcfJ-S- (cluster rate) ± 9 A# V^t* 9 a^Sr*^ 
i-5CtlC«tl?fT9 (Bl2COSt34) . 
[0 0 18] -Ercoigl. fcL**^fcb. 7 
6 2)5, *:<Dftm&%:*2i\Zttm-rZ> (il2COSt3 
5) o #t>Jl4, #J;LI4\ mxE-r^k-means 7^9^ 
Sr. k = 2tLtffll^„ 

[0019] — o^t^jsftfcflj»B*aJ*> 

ofcftibli. Hi 2 OS t 3 2gl|^^t) (El 1 2 
OS t 3 6) „ tUii'ofcftW, EMffi-JHtKB 7 
7#, ^fl^ixfc#EFfllc|2#Sr(+^i-^> (Hi 20S 

t37). ^l-c, w.-%it&mmmt)&7 s*k ^tsa 

AS:l5*'fkt.fc#tSfl:Srl±J^-rs (EU2 0S3 8) „ 
[0 0 2 0] 4^ rHlco^TIi, r##^cfifcu 

©KIB»W" . Sg5l§]An*ut^#*#f&:*3l, 199 

1. ) l£#LV\ 

[00 2 1 ] El 8 (4, BTt^fWf-^A^. ±15 
^fe^HfcfiJ-a-O^Sffi (prune rate) 5:7 0%, 
btltz? 7^^i!)?roi/- h (cluster rate) 3r 4 0 

S„ 

[0 0 2 2] 

[0 0 2 3] ^Jxli, El 3 iZffk-T X i> t&TWRf—9#± 



(4) 4#BB¥7-9 3 158 



5 

®C*N0 iC^fL-C {6 2 0*^5, 6 2 0.gJUr6 4 0* 
SSx 6 4 0H±6 6 om 6 6 0«±6 8 0*1, 6 
80EX±.} ii5± 5*EPfl^S'JS:m\ :<DE» 
W(iJ;oT#ibti-fc ; ett j e4x(OE^I-, N2 
AOi§^<t BCD^iT-0!l;ll4\ {CI . C2 , C3 
, C4 , C5 } i55J:54A*^»«^5^o* 

[0 0 2 4] La>U AfCJ:5rcoJ:?4Mtt, * 
[0 0 2 5] *^roSWtt5i:r5li, atttttr^: 

[0 0 2 6] 

[«RHSr#»i-sfcft«>^a] ±BB«j«r***-3fc 

[0 0 2 7] 

9*—* ^wjg l <D#®*co§*:ffii:* 
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*#tt!R0*a«^»je»fc»£tti;L**-5a\ *7ili7 f 
5*I-o^t;, basils'****** 

[00 2 8] #$§9314, 1 £04#®S 

7*-*0>££-i;:*tU MEIMottttnsc-cto 

y X^ld«"*-*^9^— *-c*>3*9;**»i4-, if 

?BMf*J:0/h$ *>3VM4, * 9 

^^»t»9**S«:SV'— r> (prune rate) |CIR*5*S 

*«f**«o»«a*R3e«*lciR* 5t*TS*6J:5i: 
[0029] 5 |c, *tttt«r*M4l£*»£L-C5WH 

rott*) t, flWMKfc 

y^-^a^Rtv^uf-^ <£> JH±8'J**^£riifJ 

j£ft3Ci:l;i«fc 5 ft***:***"* r t 9 * 

[0 0 3 0] S£oT*3SW{::«fc*Ui» il^fiiSr t 5**® 

[0 0 3 1] 

T, 5 lttSt^Ttc^Bffl^-^A**, 5 2I4»^*^ 
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gi, 55 imiet^m&^itmm. 5 e ttmttntut 

1MB, 5 7t4«fcJt*tH*ffi, 5 8I4&S*. 5 9li4S 
fOft^Tfc, 6 0li^7^^y^», 6 114^7 > — 

[0 0 3 2] Ztlb<Ol*>. tkfe*^ m^r AJlZK 

(prec) ) . &7£*±&mTWi£\zm\<^m-~<Dftm? w 

(prune rate) % tLt, ^-X. fettfc* 9 * 
9^<£>U— h (clusterrate) ^i*0/<7^-^ • T- 
* Sr A -f 5 fc «> <£> t> "C $> ^ e 

[0 0 3 3] ^tz. St^^ricllfrTW&SBS 2tt, ^-x. 

£ ft/Hit <fc<£>M (diff) 39*, (prec) SXTX 

*>5^if5^SrWWrU 91 (diff) *»SI©tt«preca 

[0 0 34] »)e*^ric«B-5 3 14, WKSlKff 5 4 
tco^T (El 2 cos t 2 l) &»<Dfflf3*S»ttlO»0 

jg-rr tzmm-rzhnxhv, mmw&mm^tmw: 

5 5 f4ffi£ttHR*ttJFffi 5 6 *s*«SttttJfc?lc»Kft 

bjlfe^^^^R^OU-h (clusterrate) SrJHl^ 

tw©u-h«:ifctrtm5ftbtf, ttneaijRffi 
«*iB#^ss«5 5<d«j*i4B 1 1 \z^Lit^(omaL 

[0 0 3 5] «S*«ilt*«5 6l4, ^-Xbtt 

fcW«««^S<0«rofflf«*I (S) i, £T<D«r«* 
Ai Co^T, ^OWaSiS^Ofie^fcSdMCioT'r 

Lfc*<Z>*«»0««*OSiE (Ai , 40 
S) , S&K-t^gain (Ai , S) = I (S) — E 

(Ai , S) *rtt»i-afc<D-e*>9, #®*3l^a55 4 
ttd©«f*d»b, _Lffi^gain (Ai , S) V* 

[0 0 3 6] gt^ffi^^ 5 7 tt»6**J**TfflJ6« 
5 2^r©l|»©M*Ti:«llrLfcBI^ *a&tK£ 

^5 aasftriib-c***©***^— * 5 9 £ tt^ 
stfcaKft^r-^ 5 9 fcftjfcttfcfcje*^-* 5 
8titiu*t«to-efc5 0 ^9^^yv^6 0«i 

■H«l«0*ttN©M[0«*«C»L, Tdiff/precj ®C0 so 
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[0 0 3 7] o#'lw±IE««<7)*3£H<Of^fflSrB2(0 7 

-^ , *^^lc««sc:^cE»^i^-cv^5^:■^-s 0 «i«a3 

[0038] i3tl NO , Nl , N2 1 5 3 3o(OH 

(gI260St2 0) o *A*fflS6 1 *><b 

*©»«fc«»i:*Jx*«l* (#3I<D&fi (prec) ) % 

9 7 * tc#?s s tiitr- * coftmm v # 
mmomnjzm (prune rate) , mmm^Wi&^itm 

S5 5TJB^feix5^7;**»!)*0>W- h (cluster 
rate) & <t'tfV*7 ;* — * • £*b5o 
. [0 0 3 9] fc**^*?*— *AA»5 l^&ntKM^ 
A^£ix3£ (g]2<DSt2 0) , St3£*^ric»T*J3e 
SS5 2tc4oT, 4-*.e>nfcBil**«^JIH4NOtt[(Oft>: 
IBirS/Wfi^O^ (diff) *S»SOfitff-C«>-5precJSlT 
"Cfc^^^SflJSf^tt-S (i2OSt30) o ^<7>*£ 
H (diff) *S5>Si^8Eftprec£JLT"C*>oT, "T^T 
(OW Mftm 9 ig Llcov^-^te 9 IP] C ^ & iiftt V > 5 

2 2) , rtt(C±oT^*Ui*Si5 5 7iS^*(Of- 
^ 5 8^ttl^L (120S t 2 3) , ^^Sr^^SSQf 

[0040] *5Xtj:^b£l±*7X* y s *sf&6 OX 
(D??** V >ytBM\ZAZ>o # 7*? V >"?&6 OX 

(4, mmm<om&H<nm.<DM&\zmL, rdiff/ P recj 

(B20St29)' 0 rixlc(4, Mx.(44^*PC0k- 
means XA^fflV^-5 0 
[004 1] ^9** y 014^9^ 

9 ]) ^^OfttSSro^oJ: -5i-L"CtT5o ^> &*9* 

{667}, {67 4,681}, {688} 
k^0?7** frm&tl&f, {6 6 7} (D?7*?te 

rjWJI/J^b "6 7 0. 5" tATj irfi5*m<D»JB^ 
7Xb^Z.. {6 7 4, 6 8 1) 0^7^^li T "67 
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9 

0. 5" "6 8 4. 5" ^Tj t^o&ifi 

[0 0 4 2] V >-?tV>6 OlCioT^S^^^ 

[004 3)^7^^5 >-^9$6 0(C<J:5^^7^O 

icA^)> *1\ ft3e*±jaa»T*ift»5 2fc*wc* & 

<D#S * 9 * S Hfcix - * o 

(prune rate) fiJLLS: J&»£ 5 fl^^Br £ *b5 (H 

2<0S t 2 1) o t>L4MB»9*K3e«[ (pr 

une rate) J^JhS: £#>Tl^T, ^TOWflftlft 0 £ L 

t 2 2) . *^*ttJ>3S5 5 7^*36* (5 8) 
(S t 2 3) , jtHMr^Ti-S.' 
[0 0 4 4] E^tf^^y^S t 2 1 <D2pJ^<Ofe*. fe 

L4MIK0*RJ6te (prune rate) £JLb Sr £ » "C I ^ <£ V ^ 

JE*4«»5 3ttt, »«H«S5 4tJ:otaRS 
Mtr3MWLT*ft«xO«$Mcov*T (B2©St2 

[0 0 4 5] r<DB*, 5 9©ttl:»L 

Wffc*oa*ltt, tBS1f«fifh»SfB5 6£>H-*!S*S:fc 3<> 

ts^fttt*^ s 6 -c»#* btttzwmmm& s ^^ott 

ill (s) £Ttf>4#^ftAi icoivr, 

if offit-fcS^I- J: o t f - ^ Lfc«o#«U 

#<£>i»«ft(D?nE (Ai , S) . £ £>I^O^gain (A 

i , s) =i (s) -e (Ai , s) ^un^r^^x 

*W-*SR5 6*5*«)fc<>00 5*>. JblE^gain (Ai , 

s) ****** v*«Mft**a<& (B2<ds t 2 7) . 

[oo4 6] z<r>m. hLW&m^^mm&zt&hv 
tfjootcHbii (gi2os t 2 4) % %Rffi4ftKft£# 

[0 0 4 7] £JLT"t?tt, V^«6 0^*5V^T 

wciaw-rao m4ti. ^^^^ y >^6 O^V^T 



^PS¥7-93 1 58 

10 

(!2(OSt29) |C*>V^Tffll^e>ttS^*P 

[0048] *7** y >^a$6 oic±5*9** y ^ 

7— (k) ^IrA^t^tfeCfc^r 
-^/kAASl 1**6, *1\ ^9**y>-^£*x5 

i'<7*—? (k) dSA*SK5wfcJcJ:*)BB*&Six5 
(B50S141) 0 f-^/kAMl ld*5>A** 

[oo4 9] wOx— *ia«s&i 2jcfiM***tfc«r— * 

14, ^9**y v^HfTSBl 7iW««J*Mb«i 3ic 
4i?>nSo t5i, 5p*Sffl[«0fflit»i 3ii^9^*o 
^EtSSBl 2Jw«^Sixfc7 f -^^>ifeffi^ 

?7X?<D¥-&)m.<D$)mik*-fZ> (!5<OSt42) e 
[0 0 5 0] V^HtTWl 714, 

^ffitiffll 2 KlEISSih/r 1*5 ^rtliSfc 
5fiv^^ffiS:ifo^7^^^4:^S-rs (@5(OSt4 

3 (?7** y y^i) ) o 

[0 0 5 1] -t LT X *0>te*l4*9;** !J 
lt^?^* 5 yy*JHMHH 8flt#t8. oiv?# 
*9**o¥*Sffi{R«Fffl$l 5lcfifei#SlxTV^S^*SHtD 

AV-NEW^rBufllCO^pl^fltDAV-OLD^ It fiul§10>4§» ? 9 * ^ 

sp««««f«l 4— t Ut«, ^7^^y>^*s 
*»fiFS51 8C*TLT, ¥*S«tW-*«2 0^#^9^* 
OSpiSrtHrH-* b (H5<DSt4 4) , ^cotf»(cJ:i9 
^Pjjxfc^JSffiSrJffbV^iSliiCDAV-NEWfc lt§^7^ 
^^>T«MtfilMpff l 5 dfittF-t-*. 
[0 0 5 2] ::t, ^9^^¥^it««l 6*5 % ^.^ 

9^*05PJS«[««F«B1 5tCfife#$tLfc»fLV^JSffl[D 

av-new i: , striao^^^^^wti^wi 4^«»s 

T V * £ flu El (D fit D A V-0LD t LT L 

v^S^SrfiJSr-rs ([D5CDS t 4 5) . 
[0 0 5 3] #7X*¥-i%l£%zm 6[C£Z>%&mWi<0 

5<DS t 4 6) »Tt"5o 

[0 0 5 4] ^y^S t 4 6 (DitKO^*, fM#35 5 ^ 

£x±&? yx? y v^as6 oizteftz??*? y 

[0 0 5 5] 0614, m 3 ^gfflf-^MLT, » 

a*r*4*«*s:No , »ioes ( P r ec ) ?: H io\ 

4-X.6ixfc^7^^^0^^^ h (cluster rate) £: 
"4 0%" . ^ffiMQ^KSIt (prune rate) ^"99 
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[ 0 0 5 6 ] H 6 <0&5£*I4, r^&fiNl & "6 2 
1. 5" E»mD> #tSfflN2 2*A-Cfc3&<b, 
fiNO (Offili " 6 7 0 . 5" i>t "6 8 4. 5"©^^ 
*>5. ZoXtK (N2 iSBf) , Nl iiWTttb, N 
0 <Dfitl4 "6 5 6. 5" frb "6 7 0. 5" <DmX&> 
-5o t5Tft<-J ir5 9*PlS5r^-ro 

[0 0 5 7] C6*0*ifelC*il^-Ctt, «*5£*0> "51" K 

[0 0 5 8] s-fsic, *ssgnri. tfcffi£fci4lE-!§"eSt 
JRti fc^-TIS 2 < t 2 iro«ffi £ 20 

mmvmbizxvTZ-zz?? * lt^h^ 

■ [0 0 5 9] -tUT. ^(OXotimmziS^X. Wk<£> 
&Wr-?ZZZ.Zb, &:7Z*£.l£¥m*mm5-Z.bfr 

blc£K>7£H5>?7*?%ift\cfrmLXttM?7Xb-}- 
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[00 6 0] *S§^I4. 1 Ottttfi 

^ffl<D^Sr^-r^2co#mfiiO'>/j;< 1 1 2 

KjMS*'<? > — * TfcS * 7 7. *&14, a.— tF^SiK.fl 

birz>&m<ong. (ftmnnm z5-z.zzb\z£^x 

if&ffjlcftje-rs.}; ?icu-c*>9, ftS*«tti 

7 7><Ocf"t?<0^7 7^It^ , ?^^^W'— h (prune ra 
te) {^itZ*ixtfi^T <t 9 lc Lfc 
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